Skip to content

Conversation

vsalomaki
Copy link
Contributor

@vsalomaki vsalomaki commented Sep 9, 2025

The rerun-PR #526 had a bug; the log files for rebot were merged in the wrong order. Effect is that the original test-results overwrote the results from the retest and the merging of reportes created a report with the original fail-results even if retest passed. As a consequence, if there was another rerun-round due to errors, the starting point was the original output.

This PR includes following:

  • Correct reporting output, the output.xml, log.html and report.html contain combined information
  • Add better testing so that the previous round of retest is taken into account
  • Prints out retests "rounds" starting from 1 instead of 0, also suppresses (duplicate) stdout from rebot
  • Update Firefox to 142. The version 141 was no longer available in the docker build
  • Add reference to Rerunning tests into the Readme TOC

Screenshots from reports after, using the "Roll Dice"-tests:
Screenshot from 2025-09-09 21-59-53
Screenshot from 2025-09-09 21-58-16

@vsalomaki vsalomaki force-pushed the bugfix/fix-rerun-log-file-handling branch from 719d924 to aaa1d5b Compare September 9, 2025 21:10
@vsalomaki vsalomaki changed the title Rerunning tests: Fix log file handling Bug: Fix log file handling in test-reruns Sep 9, 2025
@vsalomaki vsalomaki force-pushed the bugfix/fix-rerun-log-file-handling branch from aaa1d5b to 9560927 Compare September 9, 2025 21:21
* Echo rerun-rounds starting from 1, hide rebot stdout
* Zip log-files from previous test-rounds
@vsalomaki vsalomaki force-pushed the bugfix/fix-rerun-log-file-handling branch from 9560927 to 1d36b74 Compare September 9, 2025 21:32
@vsalomaki
Copy link
Contributor Author

Proposing to change the recently added environment variable to a more descriptive, such as ROBOT_RERUN_MAX_ROUNDS

@vsalomaki
Copy link
Contributor Author

Comments? ( @ppodgorsek )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant